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Abstract 

The understanding of human central nervous 
system (CNS) depends on knowledge of its 
wiring. However, there are still gaps in our 
understanding of its wiring due to technical 
difficulties. While some information is com- 
ing out from human experiments, medical 
research is lacking of simulation models to 
put current findings together to obtain the 
global picture and to predict hypotheses to 
lead future experiments. Agent-based mod- 
eling and simulation (ABMS) is a strong can- 
didate for the simulation model. In this po- 
sition paper, we discuss the current status of 
"neural wiring" and "ABMS in biological sys- 
tems". In particular, the paper discusses that 
the ABMS context provides features that re- 
quire for exploration of wiring of biological 
neural networks. 

1 Introduction 

The understanding of the brain and the central ner- 
vous s ystem (CNS) depends on knowledge of their 
wiring [Tiirker and Powers, 2005| . Since direct record- 
ing from individual human neurons is impossible, in- 
direct methods are used. In indirect methods, a par- 
ticular group of nerve fibres or cells is stimulated and 
the responses of neurons that are affected by the stim- 
ulus (reflexes ) are recorded. Up until 1994| Turker and 



Cheng, 1994 , the wiring of the human CNS was es- 
timated by counting the number of neuron discharges 
that occur at specific times following a stimulus. But 
this indirect method is open to numerous methodolog- 
ical errors both in the stimulation and in the recording 
processes. Error free indirect estimation of wiring in 



Turker and 



Turker and 



the human CNS has recently been tested 
Powers, 1999} |Tiirker and Powers, 2003| 
Powers, 2005 j and now used in Ege University labs to 
reassess previously 'established' wiring in the CNS. 

Although, neuroscientists are performing various 
experiments to explore wirings, there are still gaps 
in our understanding of CNS because of technical dif- 
ficulties. For example, direct stimulation of nerves 
is very difficult in some regions, since they are lo- 
cated deep. And yet, there is no satisfactory theory 



on how these unknown parts of CNS operate. There- 
fore, neuroscientists rely upon the knowledge that is 
obtained in animal studies. Apparently, there is a 
strong need to predict the characteristics of these gaps 
in the knowledge by putting together information that 
is available from both human and animal experiments. 
And such a prediction can be done using computa- 
tional simulation techniques. 

Agent-based modeling and simulation (ABMS) 
seems as a strong candidate for the simulation work 
and hence the solution to the problem of putting in- 
formation together to predict hypotheses for future 
studies. ABMS is a new approach to modelling sys- 
tems and is composed of int eracting, autonomous 



agents|Macal and North, 2006 . It is a powerful and 



flexible tool for understanding complex adaptive sys- 
tems such as biological systems. 

Biological systems are highly robust, flexible and 
has ability to adapt to the changing circumstances. 
They are composed of bio-entities that operate in 
naturally dynamic environments. It is widely ac- 
cepted that ABMS coordinated by self-organization 
and emergence mechanis ms are an effective way to 
desig n biological systems|Di Marzo Serugendo et al, 



2005 



Because it is possible to associate different ele- 
ments of a biologica l process to independent comput - 
ing entities (agents) |Amigoni and Schiaffonati, 20071. 
Furthermore, ABMS allows explicitly modeling the 
environment in which bio-entities operate. 

Biological neural networks can be understood in 
terms of complex networks. Characterizin g struc 



ture 
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and function of complex 
Albert and Barabasi, 



networks 



Strogatz, 



2002 Boccaletti et al., 



is an inte rdiscipli nary app roach called net- 
work science (Borner et al., 2007 . Recent collabo- 
rative studies in network science and neuroscience 
show that CNS have features of complex networks - 
such as small-w orld topology, highly connec ted hubs 
and modularity! Bull more and Sporns, 2009] . In an- 
other work, it has been shown that an initially ran- 
dom wiring diagram can evolve to a functional state 
characterized by a small-world topology of the most 
strongly c onnected nodes a nd by self-organized critical 
dynamics|Siri et al., 2007 . Thus, it seems that neural 
wiring problem can be reduced to network formation 
problem in which each node has discretion in forming 



its links in the network relationship. In this sense 
abstractions of neurodevelopmental mechanisms 



van 



Ooyen, 2003 of biological nervous systems can be used 
to form networks. 

We believe that the use of ABMS and self- 
organizing dynamics, along with the adoption of neu- 
roscience and network science knowledge will make it 
possible to harness the complexity of this problem do- 
main by delegating software agents to simulate bio- 
entities. 

Additionally, we wish to use ABMS in neuro- 
science as an adjunct to laboratory and theoretical 
research. Simulation can be seen as a substitute for 
an experiment that is impossible to perform in real- 
ity, where i mpossibility can be either theoretical or 



pragmatical|Hartmann, 1996 . Thus, an ABMS tool 



to investigate neural wiring can also be used to make 
"in-machina" experiments and to test hypothesis. 

This paper is organized as follows. The next sec- 
tion explains the wiring problem of biological neural 
networks. In Section 3 ABMS in biology is discussed. 
Section 4 states how ABMS can be used for explo- 
ration of neural wiring. Related work is given in Sec- 
tion 5 and finally, Section [6] concludes the paper. 

2 Wiring of Biological Neural 
Networks 

The primary aim of neuroscientist working on neu- 
ral wiring research is to investigate functional connec- 
tions in between biological neural networks. This way 
we will have a better understanding about how CNS 
works. This primary aim can be broken into the fol- 
lowing specific aims: 

• To produce satisfactory explanations for the cur- 
rent situation. 

— To be able to summate information available 
from different resources for different path- 
ways. 

— To be able to pinpoint gaps in the system as 
the final working of the system is known. 

• To be able to bring out testable hypotheses for 
the unknown sections of the system. 

With its multiplicity of cell types and complex pat- 
terns of cellular interactions, the nervous system rep- 
resents the most complex organ of animals. Under- 
standing how neuronal circuits are wired is one of the 
holy grails of neuroscience. Besides many experimen- 
tal advances in determining the cellular machinery, 
theoretical approaches have also proven to be useful 
tools in analyzing this machinery. A quantitative un- 
derstanding of neural wiring can allow us to make pre- 
dictions, generate and test hypotheses, and appraise 
established concepts in a new light. 

The nervous system is a network of specialized cells 
that communicate information about an organism's 
surroundings and itself. It processes this information 
and generates reactions in other parts of the body. It is 
composed of neurons and other specialized cells called 
glial cells that aid in the function of the neurons. A 



neuron is an excitable cell in the nervous system that 
processes and transmits information by electrochem- 
ical signalling. A typical neuron can be divided into 
three functionally distinct parts, dendrites, soma and 
axon. Roughly speaking, the dendrites play the role of 
the "input device" that collect signals from other neu- 
rons and transmits them to the soma. The soma is 
the "central processing unit" that performs an impor- 
tant non-linear processing step (called "integrate & fire 
model") : If the total input exceeds a certain t hreshold, 
then an output s ignal (spike) is generated [Gerstner] 



and Kistler, 2002] . The output signal is taken over by 
the "output device", the axon, which delivers the sig- 
nal to other neurons. Furthermore, neurons respond 
to stimuli, and communicate the presence of stimuli 
to the central nervous system, which processes that 
information and sends responses to other parts of the 
body for action. 

A number of specialized types of neurons exist: sen- 
sory neurons respond to touch, sound, light and nu- 
merous other stimuli affecting cells of the sensory or- 
gans that then send signals to the spinal cord and 
brain. Motor neurons receive signals from the brain 
and spinal cord and cause muscle contractions and af- 
fect glands. Each sensory neuron receives information 
from a special ending, receptor. There are many re- 
ceptors in the skin, in the muscle, in the joints and 
within the viscera. 

Figure ^ shows a simplified wiring diagram of hu- 
man masticatory system during no masticatiorj^] This 
diagram is a result of va rious experiments established 
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in Ege University lab s | Nascr- Ud-Din et al. 
Lobbezoo et al., 2009; Sowman and Tiirker, 2008 



other past e xperiments an d animal studies (reviewed 
in detail in |Tiirker, 2002 ) . The reason for using an- 
imal studies is: direct electrical stimulation of nerves 
is very difficult in some parts of the jaws region, since 
these nerves are located deep in the face an d close 



to numerous blood vessels Scutter et al., 1997 . Even 



though the dashed lined neurons are represented like 
a single neuron in the figure, there may be a few 
(oligosynaptic) or many (polysynaptic) neurons (each 
one connected to several other ones) in that part of 
the wiring diagram. 

Using human reflex research^ neuroscientists are 
carrying on finding pathways as much as possible, but 
as mentioned above investigating some parts of the 
picture is almost impossible to obtain using current 
techniques. Consequently, there must be computa- 
tional tools (and techniques) that allow combining the 
current findings to predict the wiring of the pathways 
that are impossible to obtain in human subjects. 

3 Agent-based Modeling and 

Simulation in Biology 

Agent-based modeling and simulation (ABMS) has in- 
creasingly been adopted as a suitable approach for an- 
alyzing complex systems and evaluating theories and 



1 The diagram is simplified due to space limitations. 
2 Reflex pathways contain much less neurons than cor- 
tical pathways. 
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complexity of problem by concerning not the over- 
all system, but the behaviors of individual agents. 
It is widely accepted that ABMS is well suited for 



simulating self-organizing systems Macal and North, 



2006 



For instance, when simulating biological sys- 
tems an agent is a good abstraction for represent- 
ing bio-entities which represents a global phenomena 
when put together. 

Environment also plays an important role when sim- 
ulating biological systems. There are two roles of the 
environmen t when simulating biological systems|Klugl 
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Figure 1 : Wiring diagram of human masticatory sys- 
tem representing pathways to jaw opening (JO) and 
jaw closing (JC) muscles (different colors of neurons 
indicates different pathways). 

models of complex systems (especially for social or bi- 
ological systems). ABMS is used in a broad range of 
domains, including social and economical simulation, 
biological system s, traffic and crowd si mulation and 



et al, 2004 . Firstly, simulation can be used for mod- 
elling environment. Real bio-entities operate in natu- 
rally dynamic complex biological environments. Thus, 
when simulating the behavior of biological s ystems 
this dynamism sho uld be explicitly modeled[ Helle-| 
boogh et al., 2007 . Secondly, environment can be 
used for simulation. Since ABMS can be seen as sim- 
ulated multi-agent systems situated in a simulated en- 
vironment, in simulations the modelled environment 
should always be a first class entity th at is as care- 



in other domains Macal and North, 2006 



Since ABMS allows biological systems to be de- 
composed into several independent but interacting 
entities, u sage of ABMS for biological systems is 
widespread|Amigoni and Schiaffonati, 2007 Merelli 



et al., 2007 . Each day, more promising evaluations 



developed (e.g.: |Maniadakis and Trahanias, 2009 


Folcik et al., 2007 


Christley et al., 2007 ). 



fully developed as the agents themselves Kl iigl et al., 
2004 . This is especially true for self-organizing multi- 
agent systems, as the agents' environment guides the 
selection and self-organization process. Furthermore, 
the study of biological systems needs experiments to 
explore their behaviors. Similarly, simulation models 
of such systems must be run many times to explore if 
they behave as expected. Eventually, to be able to as- 
sess simulation results, data generated by the simula- 
tion runs and data collected from experiments should 
be compared. In such a situation, environment can be 
used as a regulator for sake of calibration in order to 
obtain result s that can be analyzed an d compared to 



actual data Bandini and Vizzari, 2006 



Basically , the reasons for using ABMS i n biology However, running an agent -based model is an easy 



are twofold |Amigoni and Schiaffonati, 2007 



task, but the analysis is not|Richiardi et al., 2006 



ABMS in biology can be used to support infor- 
mation gathering, processing and integration. In 
other words, ABMS can be used to summate in- 
formation gathered from various experiments and 
can help us to understand biological processes. 

ABMS can be used to simulate the behavior of 



biological systems. As Hartmann says Hartmann, 



1996 



"Simulation can be seen as a substitute 
for an experiment impossible to make in reality, 
where impossibility can be either theoretical or 
pragmatical". Hence, by simulating the behavior 
of biological systems it becomes possible produce 
testable hypotheses for the unknown parts of the 
system. 

Following there paragraphs explain the features pro- 
vided by ABMS that support these reasons. 

Biological systems are se lf-organized in their 



Even for simple scale simulations, we must cope with 
vast parameter space of the model. Thus, parameters 
should be tuned in order to find the optimal behavior 
of an agent performs. This optimal behavior is go- 
ing to influence the global behavior of its collective. 
Nevertheless, even if supported by a reference tool, 
the tuning process can be quite time-consuming. It is 
apparent that theories and tools allowing automatic 
tuning of parameters are needed. Recent studies ad- 
dress the problem of automatic tuning of parameters 



of agent-based simulation models Bonjean et al., 2009 



ano, 2007; Fchler et al, 2006 



Montagna and Roli, 2 009 Gardclli et al., 2009[ \Ter-\ 



nature |Camazine et al., 2001 . A system is said to 
be "self-organizing" if it is able to reorganize itself 
by managing the relations between components, either 
topological, structural or functional, upon environment 
perturbations solely via the interaction of it s comyo- 
nents, with no requirement of external /orces |Gardelli 



et al., 2009 . Self-organization allows us to reduce the 



Besides the aforementioned clear advantages, the 
main problem when using ABMS in biology is the 
level of trust to the outcome ob tained using ABMS 
|Amigoni and Schiaffonati, 2007] . In other words, the 
weak validation of the results obtained makes ABMS 
hard to trust. The reason for that is the lacking of a 
governing thoery. Moreover, experimental data ob- 
tained are sparse and thus a direct comparison to 
the results obtained in simulation is sometimes dif- 
ficult. Overcoming this drawback requires develop- 
ments of aferomentioned calibration mechanisms and, 
closer collaborations between biologists and computer 



scientists |Fisher and Henzinger, 2007] . 

4 Using ABMS for Exploration of 
Neural Wiring 

ABMS can be effectively used to tackle exploration of 
neural wiring problem due to its aforementioned ad- 
vantages. In this section we propose that the use of 
ABMS and self-organizing dynamics, along with the 
adoption of network science and neuroscience knowl- 
edge would lead us to highlight neural wiring problem. 

4.1 Proposed Approach 

There is considerable amount of knowledge about de- 
velopmental neuroscience. The study of neural devel- 
opment aims to describe the cellular basis of brain 
development and to address the underlying mecha- 
nisms. The science of studying neural development 
by computati onal and mathem atical modeling is rel- 



Prem Prem, 1993 suggests, the level should be the 



atively new van Ooyen, 2003 . Neural development 



models are used to study the development of the ner- 
vous system at different levels of organization and at 
different phases of development, from molecule to sys- 
tem and from neurulation to cognition. 

Neurodevelopmental processes can be broadly di- 
vided into two classes: activity-independent mecha- 
nisms and activity-dependent mechanisms. Activity- 
independent mechanisms are generally believed to oc- 
cur as hardwired processes determined by genetic pro- 
grams played out within individual neurons. These in- 
clude differentiation, migration and axon guidance to 
their initial target These processes are thought 

of as being independent of neural activity and sen- 
sory experience. Once axons reach their target areas, 
activity-dependent mechanisms come into play. Al- 
though synapse formation is an activity-independent 
event, modification of synapses and synapse elimi- 
nation requires neural activity. Activity-independent 
mechanisms are said to be self-organizing dynamics of 
neurons. There is no information at a higher level of 
organization than the individual neuron, so all the or- 
ganization in central nervous system and brain is an 
'emergent property' of the interaction of large num- 
bers of individual neurons. 

Besides, the small- world architecture have been 
found in several empirical studies of brain networks 
in humans and other animals and it is shown that 
CNS have features of complex networks - such as 
small-worl d topology, highly connecte d hubs and 
modularity! Bullm ore and Sporns, 2009] . More than 
that, it has been shown that an initially random 
wiring diagram can evolve to a functional state char- 
acterized by a small-world topology of the most 
strongly conn ected nodes and by self-organized crit- 



ical dynamics|Siri et al, 2007 



To this end, inspiring from the above information 
gathered from neuroscience and network science stud- 
ies we may develop an agent-based model. 

An important consideration when we use ABMS to 
simulate a system is deciding the level of abstraction 
to model the system. We can describe a system us- 
ing different levels, aspects, or representations. As 



one where the prediction of the behavior of the sys- 
tem is easiest; in other words, where we need least in- 
formation to make predictions Shalizi, 2001 . In this 



sense, in our biological neural network model, agents 
will represent bio-entities at cell and tissue level: neu- 
ron agents, receptor agents, and muscle agents. 

Neuron agents will implement the activity indepen- 
dent (self-organizing) mechanisms of neural develop- 
ment. An apt learning algorithm will then be ap- 
plied to make the network evolve to a small-world 
topology. Meanwhile, environment will control neu- 
ral development using global parameters and charac- 
teristics. Since activity dependent mechanisms require 
neural activity, they will be modeled using experimen- 
tal data obtained to calibrate the model together with 
receptor agents and muscle agents. 

5 Related Work 



Schoenharl et. al. Schoenharl, 2005 developed a 



toolkit for computational neuroscientists to explore 
developmental changes in biological neural networks. 
This toolkit develops complex network topologies in 
neural networks using pruning. However, details of 
the methodology used (e.g. how the initial random 
network is constructed) and of simulation parameters 
(e.g. how the threshold parameter for pruning is ob- 
tained) are not clear. 

Mano et. al. Mano and Glize, 2005 presents an ap- 
proach to self-organization in a dynamic neural net- 
work by assembling cooperative neuro-agents (CNA). 
The network is initialized with only unconnected 
CNAs and then during a learning period, the net- 
work self-organizes. The network of CNAs they pre- 
sented is able to define criteria for adapting the geno- 
typic transfer function, node strengths, connectivity 
between nodes, neuron proliferation, and even neuron 
deaths. 



Maniadakis et. al. Maniadakis and Trahanias, 2009 



addresses the development of brain-inspired models 
that will be embedded in robotic systems to sup- 
port their cognitive abilities. They introduce a novel 
agent-based coevolutionary computational framework 
for modeling assemblies of brain areas. They specifi- 
cally employ self-organized agent structures to repre- 
sent brain areas. Moreover, they introduce a "hierar- 
chical cooperative coevolutionary" scheme that effec- 
tively specifies the structural details of autonomous, 
yet cooperating system components. However, this 
work focuses on brain slices rather than reflex path- 
ways and aims to improve cognitive capabilities of 
robotic systems. But, introduced mechanisms may 
be used to support research efforts in the field of psy- 
chology and neuroscience. 

Apart from agent-based approaches there are bio- 
logical neural network simulators. They are used pri- 
marily to simulate spiking neural networks which are 
present in the biology to study their operation and 
characteristics. In this group we can find sophistic ated 



simulators such as GE NESIS|Bowe r et al., 20 03) and 



NEURON Hines and Carnevale, 1997 . They are de 



signed to provide biologically realistic models of elec- 
trical and chemical signalling in neurons and network 
of neurons. They support the simulation of complex 
neural models with a high level of detail and accu- 
racy. However, this research into electrical signalling 
ignores the fascinating problem of wiring of biological 
neural networks. 

6 Conclusion and Prospects 

In this paper we have shown that neuroscientists work- 
ing on neural wiring has a strong need of computer sci- 
entists. Then we have provided a critical outlook on 
agent-based modelling and simulation in solving their 
problems. 

The literature shows that, day by day, ABMS is 
getting more mature for biological systems. However, 
although ABMS is a pioneering and powerful approach 
in biology, research into the design and use of agent- 
based models is still in its infancy and requires closer 
collaborations between biologists and computer scien- 
tists. The inherent differences between biological and 
computational models, along with the difficulty of ob- 
taining precis e biological data, make both approaches 
indispensable | Fisher and Henzinger, 2007 . 

Up to now, we have established a "core" biological 
model involving various simplifications and assump- 
tions (Section 2). We proposed then a preliminary 
agent-based simulation model (Section 4). Next step 
will be enhancing, implementing and calibrating the 
proposed model. We will then compare in silico ex- 
periments with in vitro biological experiments. As a 
result of comparison we will either adjust our com- 
putatinal model or develop new/improved biological 
experiments to revise the biological model. This cycle 
will proceed until we get satisfactory results. 

We see this study as the first step for understanding 
neural circuits. Within the scope of the goals of neural 
wiring research, we are planning to develop an agent- 
based simulator that combines currently available bits 
of data into a manageable format. So that the working 
of the entire nervous system can be tested. The sim- 
ulator will be used to explore the wiring of, possibly 
dynamic, black box networks. This will probably lead 
us produce new techniques to construct and test net- 
work development inspiring from developmental neu- 
roscience as well as we will use existing network devel- 
opment techniques. Furthermore, the developed sim- 
ulator will be used for predicting future human reflex 
findings in via putting forward workable hypotheses 
about human CNS. Meanwhile, we will demonstrate 
the power of the developed simulator through a series 
of case studies. 
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